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BACKGROUND OF THE INVENTION 

1. Field of the Invention 

5 This invention relates to computer storage and server systems, and more 

particularly to such systems providing multi-disk storage in a single, field replaceable 
unit. 

2. Description of the Related Art 

10 

Many enterprises employ server or storage systems that include multiple disk 
drives and other components. These enterprises may require a high degree of reliability 
from their server and storage computer systems. If a component of the server or storage 
system fails, it may cause the entire system to fail or at least to operate in a degraded 

15 mode. Since many enterprises cannot afford extended down time from such component 
failures, it is desirable to be able to quickly address such component failures. One way 
this problem has been addressed is to make many of the components of such computer 
systems to be field replaceable or even hot swappable. Field replaceable means that a 
failed component may be easily replaced in the field with a new, functional component. 

20 For example, in many computer systems components such as the hard drives, power 
supplies, fans, and even CPU's may be field replaceable. Hot swappable refers to the 
ability to replace such a component without powering down the system. Ideally, hot 
swappable means that a component such as a hard drive can be removed and replaced 
with a new hard drive without powering down the system and the new drive will be 

25 automatically recognized by the system. 

However, in order to support field replacement or hot swapping of components, 
the system must be designed to allow easy access to all components that are to be field 
replaceable or hot swappable. This requires that the system have access panels and other 
30 openings as necessary to allow access to the components that are to be field replaceable 
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or hot swappable. In addition to access panels that may easily be opened in the field, the 
system must also be internally designed to allow access to the replaceable components. 
For example, the replaceable components should not be blocked by other components. 
Also, replaceable and hot swappable components are often mounted in a bracket or socket 
5 for easy removal and insertion. Special sockets may also be required for hot swappable 
devices to insure that hot removal or insertion does not interrupt ongoing transactions in 
the computer or storage system. 

The access panels, internal spacing, special sockets, etc., required to support field 
10 replacement or hot swappability means that components may not be packaged as densely 
in such systems as would otherwise be possible. Also, the requirements to support field 
replacement and/or hot swappability may make a system more expensive. It would be 
desirable to still achieve some of the benefits of field replaceability without sacrificing 
the loss of component density and the added expense of current systems that support field 
15 replaceable components. 
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SUMMARY OF THE INVENTION 



Conventional storage systems are typically designed to allow for replacement or 
hot swap for all essential components, such as disk drives, fans power supplies, etc. 
5 However, a computer or storage system may be provided with reduced or even no 
serviceable internal parts so that the entire device may become a field replaceable unit. 
Such a single system field replaceable unit may have a large storage capacity by 
containing multiple individual disk drives. Since there are no field replaceable or hot 
swappable parts, the field replaceable unit may have a storage density that is not possible 
10 with typical storage systems that support disk replacement and other component 
replacement. 

In one embodiment, a storage system field replaceable unit may contain eight low 
profile ATA-type disk drives attached to a printed circuit motherboard. ATA-type disk 

15 drives refer to disk drives that conform to any variant of the AT Attachment specification, 
such as ATA-2, Fast ATA, Ultra-ATA, ATA/66. Such drives may also be referred to as 
IDE or EIDE drives. Two local ATA controllers and two PCI expansion ATA controllers 
may be included on the motherboard and used to control the eight ATA disk drives. A 
series of fans may also be included within the unit positioned between the motherboard 

20 and the ATA drives. In one embodiment, each ATA drive may be a 34 gigabyte drive so 
that the capacity of the field replaceable storage system is approximately 250 gigabytes. 

Software running on the field replaceable storage system exports or presents the 
disk storage as an NFS or CIFS file system that may be mounted by client machines on a 

25 network. In one implementation, the field replaceable storage system runs the Solaris® 
operating system internally and uses the DiskSuite software to organize the disk drives 
into RAID logical volumes. File systems are then built on these logical volumes and 
exported or presented to client machines using either NFS for Unix clients or a program, 
such as Samba, for Windows clients. In another implementation the field replaceable 

30 storage system runs the Linux operating system internally using the Linux multi-device 
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management software to configure RAID volumes. These volumes may be exported or 
presented to client machines in the same was as in the Solaris implementation. 

A single field replaceable storage or computer system may include a processor 
5 coupled to a peripheral bus by a bridge device. The field replaceable unit (FRU) may also 
include system memory coupled to the processor and a network interface coupled to the 
peripheral bus. One or more drive controllers may also be included coupled to the 
peripheral bus. Additionally, the single field replaceable unit includes an array of disk 
drives coupled to the one or more drive controllers. The array of disk drives may be 

10 configured as one or more RAID logical volumes and exported or presented to client 
machines as one or more file systems through the network interface. The processor, 
system memory, network interface, drive controllers, and array of disk drives are all 
assembled together as a single field replaceable unit. The processor, system memory, 
network interface, drive controllers, and array of disk drives may be configured not to be 

15 individually field serviceable or replaceable. If the unit fails and needs servicing or 
replacement, the unit may be replaced as a whole. 

The single field replaceable unit may also include a motherboard, wherein the 
processor, system memory, network interface, one or more drive controllers, and array 
20 disk drives are all attached to the motherboard so as not be field removable. The field 
replaceable unit may also include one or more fans configured to flow air over the array 
of disk drives and the processor, wherein the fans are also not individually field 
serviceable or field replaceable. The fans may be positioned in a row between the array 
of disk drives and the processor. 

25 

In one embodiment, the one or more drive controllers may include four ATA-type 
drive interfaces and the array of disk drives may include eight ATA-type disk drives, two 
per interface. Alternatively, a fewer number of ATA-type drive controllers may be used 
in conjunction with a switch that expands the number of ATA drives that may be 
30 connected to a single ATA port. For further information on such an ATA device 
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expansion switch, see co-pending U.S. patent application, serial number 09/624,557, 
titled "Switch for Selectively Forming a Communication Channel Between a Processing 
Unit and Multiple Devices, and Associated Data Exchange Methods", filed July 25, 2000, 
inventor Whay S. Lee, which is herein incorporated by reference in its entirety. 

5 

The single field replaceable unit may also include a power supply configured to 
provide power to the processor, system memory, network interface, one or more drive 
controllers, and array of disk drives. The power supply is part of the field replaceable 
unit and not individually field serviceable or replaceable. The field replaceable unit may 

10 be configured to be coupled to a network and accessed by one or more client machines so 
that the client machines have access to the one or more file systems provided by the array 
of disk drives within the single field replaceable unit. Also, the field replaceable storage 
system unit may be configured as a RAID system and may provide storage for at least a 
quarter of a terabyte of data. Furthermore the field replaceable unit may be configured to 

15 provide office network services including issuing IP addresses to the client machines, 
web page server services, electronic mail services, etc. The field replaceable units may be 
designed to be mounted in a storage rack, such as an industrial 19 inch computer 
equipment rack. 

20 A method for providing computing resources may include assembling a processor, 

network interface and array of disk drives as a single field replaceable unit so that the 
components of the field replaceable unit are configured not to be individually field 
serviceable or replaceable. The processor, network interface, and array of disk drives 
may be configured to provide one or more file systems to client machines through the 

25 network interface. The method for providing computing resources may further include 
preinstalling software on the single field replaceable unit configurable to organize the 
array of disk drives into one or more RAID logical volumes to be exported or presented to 
client machines as one or more file systems through the network interface. After 
packaging the components into the field replaceable unit and preinstalling software, the 

30 unit may be shipped to a user. If necessary, the single field replaceable unit is replaced as 
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a whole upon failure. The storage capacity of the single field replaceable unit is not 
individually upgradeable by adding additional drives. Therefore, the method for 
providing computing resources may include upgrading the computer resources by the user 
installing one or more additional ones of the field replaceable unit. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is an illustration of a computer of storage system including multiple hard 
drives and configured as a single field replaceable unit, according to one embodiment; 

Figure 2 is a block diagram of a storage or computer system that may be 
implemented as a single field replaceable unit, according to one embodiment; 

Figure 3 is a flow diagram illustration of a method for providing a storage system 
as a single field replaceable unit, according to one embodiment; 

Figure 4 is an illustration of a network system in which a single unit provides all 
of an office main compute services, according to one embodiment; 

Figure 5 is a simplified block diagram of components for a single unit that 
provides all of an office main compute services, according to one embodiment; 

Figure 6A illustrates a top view of a low profile substrate or tray for packaging a 
computer system, according to one embodiment; 

Figure 6B illustrates a longitudinal side view of a low profile substrate or tray for 
packaging a computer system, according to one embodiment; 

Figure 6C illustrates a latitudinal side view of a low profile substrate or tray for 
packaging a computer system, according to one embodiment; 

Figure 6D is an illustration of how multiple trays 700 may be mounted on top of 
one another within a cage, according to one embodiment; 
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Figure 6E illustrates a top view of a low profile substrate or tray for packaging a 
computer system including a row of fans, according to one embodiment; 

Figure 7 illustrates a top view of another embodiment of a low profile substrate or 
5 tray for packaging a computer system; 

Figure 8A illustrates a top view of another embodiment of a low profile substrate 
or tray for packaging a computer system; 

10 Figure 8B illustrates a longitudinal side view of another embodiment of a low 

profile substrate or tray for packaging a computer system; 

Figure 8C illustrates a latitudinal side view of another embodiment of a low 
profile substrate or tray for packaging a computer system; 

15 

Figure 8D illustrates a perspective view of another embodiment of a low profile 
substrate or tray for packaging a computer system; 

Figure 8E illustrates a detail section of a corner of a substrate or tray for 
20 packaging a computer system, according to one embodiment; 

Figure 9A illustrates a partial frontal view of a cage or enclosure for mounting 
multiple low profile substrates or trays for packaging a computer or storage system(s), 
according to one embodiment; 

25 

Figure 9B illustrates a top view of a cage or enclosure for mounting multiple low 
profile substrates or trays for packaging a computer or storage system(s), according to one 
embodiment; 
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Figure 9C illustrates a rear view of a cage or enclosure for mounting multiple low 
profile substrates or trays for packaging a computer or storage system(s), according to one 
embodiment; 

5 Figure 9D illustrates a front view of a cage or enclosure for mounting multiple 

low profile substrates or trays for packaging a computer or storage system(s), according to 
one embodiment; 

Figure 9E illustrates a side view of a cage or enclosure for mounting multiple low 
10 profile substrates or trays for packaging a computer or storage system(s), according to one 
embodiment; 

Figure 9F illustrates a perspective view of a cage or enclosure for mounting 
multiple low profile substrates or trays for packaging a computer or storage system(s), 
15 according to one embodiment; and 

Figure 10 illustrates a method for replacing a field replaceable unit having a 
failure, according to one embodiment. 

20 While the invention is described herein by way of example for several 

embodiments and illustrative drawings, those skilled in the art will recognize that the 
invention is not limited to the embodiments or drawings described. It should be 
understood, that the drawings and detailed description thereto are not intended to limit the 
invention to the particular form disclosed, but on the contrary, the intention is to cover all 

25 modifications, equivalents and alternatives falling within the spirit and scope of the 
present invention as defined by the appended claims. 
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DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 

Conventional storage systems are typically designed to allow for replacement or 
hot swapping of most essential components, such as disk drives, fans, power supplies, 
5 etc. In contrast, Figure 1 illustrates a storage system 200 assembled as a field replaceable 
unit, according to one embodiment. The entire system 200 may be a single field 
replaceable unit (FRU). Storage system 200 may include multiple individual disk drives 
to provide a large storage capacity which is implemented as a single field replaceable 
unit. Since there are no or a reduced number of field replaceable or hot swappable 
10 internal parts, storage system 200 may have a storage density that is not possible with 
storage systems that support field or hot replacement of components, such as disk drives. 

Storage system 200 includes a drive array 202. Drive array 202 may include 
multiple hard disk drives. Each hard disk drive is configured within system 202 so as not 

15 to be individually replaceable in the field. Thus, the drives of disk array 202 may be 
packaged much more densely within system 200 than in conventional systems supporting 
field replacement. In one embodiment, drive array 202 include eight low profile ATA- 
type disk drives. The drives may be attached to a PC motherboard. In other 
embodiments, drive array 202 may include multiple hard drives designed for interface to 

20 SCSI, fibre channel, or other interconnect architectures. Drive array 202 may be coupled 
to one or more drive array controllers 204. In one embodiment, drive array controller 204 
includes four ATA drive controllers supporting two ATA-type drives each. Alternatively, 
a fewer number of ATA controllers may be used in conjunction with a switch that allows 
for more than two ATA type drives to be connected to each ATA controller port. 

25 Alternatively, drive array controller 204 may be one or more SCSI drive array controllers 
or any other type of drive array controller for controlling arrays of multiple disk drives. 
Drive array controller 204 and drive array 202 may be configured as a RAID drive array. 

One or more CPU's 206 and system memory 208 may also be included within the 
30 single field replaceable unit 200. CPU's 206 may operate to export or present drive array 
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202 as one or more file systems through a network interface 210. The single field 
replaceable unit 200 may also include a power supply 214 and one or more fans 212. In 
one embodiment fans 212 may include a row of fans positioned between drive array 202 
and one or more CPU's 206. Power supply 214 may be configured to supply power to 
5 CPU's 206, system memory 208, network interface 210, drive controller 204 and drive 
array 202. The power supply 214 is part of the single field replaceable unit and 
configured not be individually field serviceable or field replaceable. In one embodiment, 
the entire single field replaceable unit 200 is configured to be rack mounted and has a 
height less than or equal to 1.75 inches. In another embodiment the height may be 
10 limited to only one inch. 

Figure 2 illustrates a field replaceable unit 200 according to one embodiment. 
The system includes one or more CPU's 206. In one embodiment, CPU's 206 may be one 
or more Sparc type processors. Alternatively, Pentium® type, Power PC® type or other 

15 types of processors may be employed. A host bridge 209 may be included to interface 
CPU's 206 to system memory 208 and an interconnect bus such as a PCI bus. A network 
interface 210 may be included to provide an interface to a network, such as a LAN. Drive 
controllers 204 are coupled to the interconnect bus and may be ATA/IDE type controllers 
in one embodiment. In the embodiment shown in Figure 2, drive controllers 204 include 

20 four ATA/IDE controllers, each controlling two ATA/IDE drives so that drive array 202 
includes eight ATA/BDE drives. In one embodiment, 34 gigabyte ATA/DDE drives are 
used so that the single field replaceable unit provides approximately 250 gigabytes of 
storage. ATA/IDE drives may be preferable for their lower cost and availability. 
However, other types of drives, such as SCSI, may be employed. Drive array 202 

25 coupled to the one or more drive controllers 204 may be configured to be organized into 
one or more RAID logical volumes and exported or presented to client machines as one 
or more file systems through network interface 210. The processor 206, system memory 
208, network interface 210, one or more drive controllers 204, and drive array 202 are 
packaged or assembled as a single field replaceable unit so that processor 206, system 
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memory 208, network interface 210, one or more drive controllers 204, and the drives of 
drive array 202 are configured not to be individually field serviceable or field replaceable. 

Software running on processor 206 exports or presents the disk storage 202 as an 
5 NFS (Network File System) or CIFS (Common Internet File System) file system to a 
network through network interface 210 so that the file system may be mounted by client 
machines connected to the network. In one implementation, the Solaris operating system 
is run using the DiskSuite software to organize the disk drives into RAID logical 
volumes. File systems are then built on these logical volumes and exported or presented 
10 to clients using either NFS (for Unix clients) or a program such as Samba (for exporting 
to Windows clients). In another embodiment, system 200 runs the Linux operating 
system internally using the Linux multi-device management software to configure RAID 
volumes. These volumes are exported or presented to clients in the same way as in the 
Solaris implementation. 

15 

Thus, a single field replaceable unit including all the components necessary to 
provide for a large RAID storage system is provided. The single field replaceable unit 
may include one or more processors, a network interface coupled to the processors, and 
an array of disk drives coupled to the processors and network interface. The array of disk 

20 drives may be configured to be provided as one or more file systems through the network 
interface. The processor network interface and array of disk drives are configured not to 
be individually field serviceable or field replaceable. Such a single field replaceable unit 
may be coupled to a network through the network interface so that one or more client 
machines may be coupled to the network and configured to access over the network the 

25 file systems provided by the single field replaceable unit. The number of physical disk 
drives of drive array 202 in a single field replaceable unit may be fixed so that disk drives 
may not be added or subtracted from the unit in the field. 

A large amount of storage configured as one or more network file systems and as 
30 one or more RAID logical volumes, for example, may be provided as a single field 
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replaceable unit. All components necessary to implement such a system including CPU, 
system memory, and network interface, necessary for exporting or presenting the file 
system to the network, the drive array controllers, and drive array itself are provided 
within the single field replaceable unit. In some embodiments, the single field 
5 replaceable unit is sealed so that the internal components are not readily accessible in the 
field. In some embodiments, these components are mounted or configured within the 
single field replaceable unit so as not to be individually field serviceable or field 
replaceable by a typical user. For example, the components may be fixed in the unit so 
that special tools are required for their removal. In other embodiments, the components 
10 may be physically arranged so that the means to remove them are not accessible without 
disassembling large portions of the unit. Various other techniques may be employed 
inhibit the field serviceability of the components. 

The single field replaceable unit 200 may also include fans and a power supply 
15 which are also not field serviceable or replaceable. Thus, if a critical component of the 
system 200 fails, then the entire field replaceable unit is replaced for a new unit. In one 
embodiment, the field replaceable unit may include a data siphon port to facilitate the 
transfer of data from the drive array of the old unit to the new unit. By not supporting any 
field replacement and/or serviceability of internal parts, the system 200 may be designed 
20 much more densely than other storage systems that provide and equivalent amount of 
storage (e.g., at least a quarter of a terabyte of storage). The single field replaceable unit 
200 also eliminates time spent having to trouble shoot individual components in the field. 
Instead, the entire unit is replaceable. 

25 Turning now to Figure 3, a method is illustrated for providing a storage system as 

a single field replaceable unit, according to one embodiment. The method includes 
packaging or assembling the components of the storage system, such as one or more 
processors, a network interface, and a drive array, as a single field replaceable unit, as 
indicated at 400. The single field replaceable unit may have no field serviceable or 

30 replaceable internal parts. Software may be preinstalled at the manufacturer on the field 



Atty. DkL No.: 5181-5580G/P4635 



13 



Conley Rose & Tayon, P.C. 



replaceable unit to organize the drive array into one or more RAID logical volumes to be 
exported or presented to client machines as one or more file systems through the network 
interface. After assembling the components as a single field replaceable unit and 
preinstalling the RAID and file system software, the single field replaceable unit is 
5 shipped to a user, as indicated at 404. If a failure occurs, the entire field replaceable unit 
is replaced (e.g. by the manufacturer) as a whole, as indicated at 406. Also, since the 
single field replaceable unit cannot be individually upgraded by installing additional 
internal components, the user may upgrade by installing additional single field 
replaceable units. 

10 

= n Turning now to Figure 4, a network system is shown including one or more client 

13 computers 502 coupled to a network 504, according to one embodiment. The client 

pj machines 502 may be desktop PC's, workstations, terminal devices, etc., as may be found 

^ in typical office environments. The network 504 may be a local area network (LAN), for 

^ 15 example, employing the Ethernet protocol. The client computers 502 obtain multiple 
' office computing services from a single unit 500 also coupled to network 504. File 

^ services, email services, web services, and network services, for example, are all provided 

iy by the single unit 500. Thus, multiple or even all of an office's main computing services 

;3 are provided by the single unit 500. 

20 

Single unit 500 includes a large amount of local storage 508. This local storage 
may be an array of disk drives configured to be supplied as one or more file systems to 
the clients 502 over network 504. The drive array may be configured as one or more 
logical RAID volumes. Single unit 500 performs file services, making the storage 508 

25 accessible to client machines 502 over network 504. Single unit 500 also may perform 
network services for an office environment. Network services may include the issuance 
of IP (Internet Protocol) addresses for network clients. In one embodiment, IP addresses 
may be issued dynamically through Dynamic Host Configuration Protocol (DHCP) 
services. The single unit 500 may also operate a web service that serve pages from 

30 storage 508. Thus, single unit 500 may perform as a web server for an office in which 
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web pages and other web related data are stored on storage 508. The web service 
provided by single unit 500 may also be the primary access point for administering single 
unit 500. The single unit 500 may also operate mail services over network 504 for the 
client machines 502. The software to implement the above described services may be 

5 preinstalled on the single unit 500 before shipping so that the end user may simply 
connect the single unit to its network to obtain many or all of the office computing 
services on a single unit. Thus, single unit 500 may be the central point for most or all 
main office computing services to client machines 502. Not all of the services illustrated 
in Fig. 4 may be required in all offices. Also, additional services beyond those illustrated 

10 may be provided by single unit 500. 

Turning now to Figure 5, a simplified block diagram of components of the single 
unit 500 is illustrated. Single unit 500 may include one or more CPU's 202 coupled to 
system memory 604, data network 606, and mass storage 508. Software to implement 
15 various computer services, such as file services, email services, web services, and 
network services may be executed by CPU 602 from system memory 604 and storage 
508. These services may be made available to client machines through network interface 
606. 

20 Thus, a single computer system may include a network connection 606 configured 

to be coupled to a network including a plurality of client machines. The single unit 500 
also may include a mass storage array configured to be exported or presented to the client 
machines as one or more file systems through the network connection 606. One or more 
processors 602 may be included within the single unit 500 and coupled to network 

25 connection 606 and mass storage 508. The processors 602 are configured to execute a 
file server configured to make the one or more file systems available to the client 
machines through the network connection. Processors may also execute a network server 
configured to assign network addresses to the client machines, a web server configured to 
deliver web pages stored on mass storage 508 through the network connection 606, and 

30 an email server configured to provide email services for the client machines. The 
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network connection 606, mass storage 508, one or more CPU's 602 configured to perform 
file server, network server, web server, and email server functions are all included within 
a single unit configured to be connected to a network through a network connection or 
interface. 

5 

Also included within single unit 500 may be a print server configured to be 
executed by CPU's 602 to provide printing services for the client machines. A data base 
server may also be included in the single unit 500 executed on CPU's 602 in order to 
provide access to a data base stored on storage 508 for the client machines. The one or 

10 more processor 602 may execute a multiprocessing operating system. The file server 
provided by single unit 500 may be configured to present the storage 508 as a NFS 
(Network File System) or CIFS (Common Internet File System) file system to the 
network through the network interface 606 so that the file system may be mounted by 
client machines. The file system may be configured to be accessible by Unix clients 

15 and/or Windows clients. 

In one embodiment, mass storage 508 may include multiple ATA-type hard 
drives. Alternatively, SCSI or other types of hard drives may be employed. In one 
embodiment, single unit 500 providing file services, email services, web services, and 
20 network services is implemented as a single field replaceable unit, such as described in 
conjunction with Figures 1, 2, and 3. 

Thus, a single system may be provided to provide many computer services 
required in an office as opposed to employing separate specialized systems for each 

25 computer service. For example, file services, web services, email services, and network 
services may all be preinstalled on a single unit and shipped to a customer so that the 
customer only has to connect the single system to a network in order to obtain the bulk of 
the computing services required for a small office. Instead of computing services being 
distributed across multiple machines, the services are preinstalled and centralized on a 

30 single unit. The single unit may be designed with multiple processors and employ a 
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multiprocessing operating system so that sufficient performance is available to provide 
the plurality of computing services. Also, a large storage is included with the single unit 
500 to provide ample space for file, web and email services. Other services, such as 
printer and database services may be included in the single unit as well. In some 
5 embodiments, the single unit may be a single field replaceable unit with limited field 
serviceable or field replaceable internal parts, as described above. 

Turning now to Figures 6A-6C, a low profile substrate or tray for packaging a 
computer system is illustrated. A computer system packaged within the substrate or tray 

10 700 may be a single field replaceable unit such as described in conjunction with Figures 
1, 2, and 3, and/or maybe a single unit system including various office computing 
services, such as file services, web services, email services, and network services, such as 
described in conjunction with Figures 4 and 5. In a preferred embodiment the substrate 
700 and the components mounted on substrate 700 have a maximum height of one inch. 

15 In one embodiment, the tray 700 is based on a 16 inch by 22 inch printed circuit board 
reinforced with ribs 702 and 704 in both x and y dimensions. The substrate 700 is 
populated with low profile components to implement a computer or storage system. The 
maximum height for one embodiment of the tray 700, including the PCB thickness, 
components and necessary clearance, is one inch. The structural ribs 702 and 704 may be 

20 oriented or configured to allow front to back air flow (e.g. latitudinal ribs may be 
perforated or broken) and to allow the tray 700 to be slid into a rack or cage 
independently (e.g. without interference) of other trays 700. 

As shown in the top view of Figure 6A, the computer system tray 700 includes a 
25 substrate, one or more longitudinal ribs 702, and one or more latitudinal ribs 704. The 
number of ribs shown in Figure 6A-6C is merely one example and other numbers of ribs 
may be employed. The ribs divide the substrate into multiple sections. One or more of 
the sections 710 are configured to hold a two-dimensional array of disk drives. Another 
section of the substrate, section 706, may be configured to hold circuitry for accessing 
30 and managing the two-dimensional array of disk drives. This circuitry may include one 
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or more processors and/or disk array controllers. The substrate 700 includes at least one 
set of either longitudinal 702 or latitudinal 704 ribs positioned in the direction of a first 
axis of the substrate. This set of ribs separates the substrate into the different sections 
configured for holding the drive array and control circuitry. Another section 708 may be 
5 included and configured for holding one or more power supplies for supplying power to 
the drive array and control circuitry. 

The substrate may be configured to be mounted in a cage or rack along with other 
such substrates. In one embodiment, the substrate 700 is configured to be mounted inside 
10 a standard 19 inch rack. An edge connector may be provided at the rear of the substrate 
to provide connectivity to a back plane that interconnects multiple such substrates and/or 
provides power to the substrates. 

The substrate or tray 700 may include a power supply section 708. The tray 700 
15 may receive power (e.g., through an edge connector) from a Telco-standard 48 volt DC 
supply. Local power regulation may be provided in power supply section 700 to convert 
the 48V DC signal to the voltages required by the components on the tray 700. Brick and 
half brick form factor integrated power supply modules (e.g., 0.5 inch x 3 inch x 5 inch) 
may be mounted in section 708 to provide the local regulation. The AMPSS modules 
20 (e.g., ALBOA, 240 W) from ASTEC are examples of such modules. These modules 
provide a low profile solution. 

Turning now to Figure 6D, an illustration of how multiple trays 700 may be 
mounted on top of one another within a cage 750 is illustrated. Trays may be mounted in 

25 the cage 750 similar to how trays are slid into a bakery rack. Slots may be grooved out in 
the internal sidewalls in the cage to accommodate the tray, or rails may be provided. 
Each tray 700 simply slides into the cage from the front and connects to a back plane at 
the rear of the cage via an edge connector. As described above, the back plane may 
provide electrical interconnect between the trays and may also provide power connections 

30 for the trays. In one embodiment the back plane provides a standard interconnect, such as 
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the PCI bus or a high bandwidth variant of the PCI bus, or a switched interconnect fabric, 
such as that proposed by the Infiniband Trade Association. 

To maximize space, in one embodiment each tray is not individually packaged 
5 inside its own metal case. The longitudinal and/or latitudinal ribs provide structural 
support so that the weight of the tray itself does not cause cracking or collapse once 
installed in the cage 750. The ribs provide enough strength such that the tray does not 
collapse under its own weight. To avoid sagging in the middle, components may be 
mounted on a PCB such that heavier components are distributed near ribs. Also, the ribs 
10 are designed to rest on top of one another when mounted in the cage. Dummy trays 
having ribs but no active components may be inserted in place of trays that are removed 
or uninstalled. The ribs may extend downward as shown in Figure 6D to rest on the 
lower tray or cage floor. Alternatively, the ribs may protrude both above and below the 
substrate. 

15 

In one embodiment, the tray 700 may include a row of fans across the tray, as 
shown in Figure 6E for example. The fans may be situated between two latitudinal ribs, 
for example. In this embodiment the latitudinal ribs may be low profile ribs or may be 
perforated to allow airflow. In addition to, or instead of, providing small fans on the tray 
20 itself, the cage in which the trays are mounted may include a set of fans (e.g., 3.5 inch x 
3.5 inch fans). The cage fans may be located at the back of the cage. To facilitate front to 
back airflow, the cage back plane may be perforate or otherwise appropriately shaped. 

Turning now to Figure 7, another example of a tray 700 is shown. The tray 
25 includes a two-dimensional array of disk drives (drives 1-16) mounted on a substrate. 
The two-dimensional array of disk drives extends across the substrate along a first (e.g. 
latitudinal) and second (e.g. longitudinal) axis of the substrate. Circuitry for controlling 
or managing the two-dimensional array drives is also mounted to the substrate. The 
control circuitry may include one or more processors, drive controllers, and drive 
30 interconnect components. A first plurality of ribs (e.g., longitudinal ribs 702) are 
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positioned in the direction of the first axis and separate the control circuitry from the 
array of disk drives. 

To provide for a low profile and low power design, hard drives designed for 
5 laptop computers may be used for the drives of the two-dimensional array of disk drives. 
These are typically 2.5 inch disk drives with a 0.7 inch height which do not give out much 
heat and thus facilitate a high-density design. The embodiment of Figure 7 shows eight 
disk drives mounted on each of a left and right region. This prevents the substrate from 
sagging in the middle section. In some embodiments the tray may be further divided by 

10 one or more latitudinal ribs 704. The latitudinal ribs may be lower profile ribs or may be 
perforated to allow for front to back airflow. A latitudinal rib may divide the middle 
section into a front and back section. The front section may include control circuitry and 
the rear section may include power supplies. The ribs may be metal ribs and may be 
fashioned to serve as electromagnetic barriers and/or heat sinks for the power supplies. 

15 The power supply section may also include a backup battery as well. 

In one embodiment, three trays, such as illustrated in Figure 7, may be mounted in 
a single cage or enclosure. Each tray may include sixteen 2.5 inch laptop disk drives 
(having a height of 0.7 inches) for a total of 48 drives providing one terabyte of storage 

20 plus 200 gigabytes of hot spare storage, for example. Alternatively, standard 3.5 inch 
desktop disk drives may be used. The substrate may be designed so that each desktop 
disk drive occupies the space allotted for two of the smaller 2.5 inch disk drives. This 
alternate design requires no changes to the substrate except for possibly the addition of a 
flexible cable to connect 3.5 inch drives to the 2.5 inch drive connector on the substrate. 

25 The cage or enclosure may be designed to accept either two trays using the taller 3.5 inch 
drives or three trays using the lower profile 2.5 inch drives. Each substrate, or 
alternatively the entire enclosure, may be packaged as a single field replaceable unit as 
described in regard to Figures 1, 2, and 3. Also, multiple office computing servers may 
be installed on a substrate as described in conjunction with Figures 4 and 5. 

30 
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Turning now to Figure 8A-8E, a somewhat more detailed example of a substrate 
for mounting an array of drives and control circuitry is illustrated. Note that the specific 
configuration of components and the dimensions shown in Figures 8A-8E are merely 
given as examples. Other dimensions and component placements may be employed in 
5 other embodiments. 



Figure 8A shows a top view of the substrate. One or more longitudinal ribs 702 
and one or more latitudinal ribs 704 separate the substrate into multiple sections. Drives 
902 are mounted in one or more of the sections to form an array of disk drives. Another 

10 section is configured for control circuitry, such as shown on controller board 920. The 
controller board may include one or more CPU's and drive controllers. In one 
embodiment, the drives 902 are ATA-type drives and controller board 920 includes an 
ATA switch device to allow more than two ATA type drives to be connected to each 
ATA port of an ATA controller. See co-pending U.S. Application Serial No. 09/624,557, 

15 entitled "Switch for Selectively Forming a Communication Channel Between a 
Processing Unit and Multiple Devices, and Associated Data Exchange Methods", filed 
July 25, 2000, inventor Whay S. Lee, which is hereby incorporated by reference in its 
entirety, for a description of such an ATA switch device. Another section of the substrate 
is configured to hold one or more power supplies 908. The power supplies provide the 

20 required voltages for the disk drives and control circuitry. In one embodiment, the power 
supplies convert from a 48-volt DC power signal provided to the substrate on edge 
connector 904. Edge connector 904 may include redundant power supply tracks wherein 
the two illustrated power supplies 908a and 908b are redundant power supplies so that if 
one supply fails or if the power supply connection to the edge connector for one power 

25 track fails, power will still be available on the redundant track or supply. Alternatively, 
or additionally, the power supplies may include a memory battery backup power supply. 



Figure 8B and Figure 8C show side views of the substrate in the longitudinal and 
latitudinal directions respectively. Figure 8D shows a perspective view of the substrate. 
30 Turning now to Figure 8E, a detail section of a corner of the substrate is illustrated. As 
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shown in Figure 8E, the longitudinal ribs may include a top portion 930 and a bottom 
portion 932. The bottom portion 932 may be configured to mate with a corresponding 
top portion 930 of a lower tray when the trays are mounted in a cage or enclosure. Thus, 
the longitudinal ribs and/or latitudinal ribs of each tray may be configured to rest upon 
5 ribs of a lower tray when mounted in a cage. Also, the substrate may include protrusions 
940 along the longitudinal edges for sliding into grooves or rails in the internal sidewalls 
of a cage, rack or other enclosure. Thus, the trays may be slid into a cage to form a 
vertical stack of trays resting upon each other's ribs. If one tray is removed, a dummy tray 
may be inserted to provide rib support so that the trays do not have to be reconfigured 
10 within the cage. 

The cage may include a back plane with connectors for edge connectors on each 
tray. The back plane may provide I/O and/or network connectivity. In one embodiment 
the back plane provides a switched, point-to-point I/O interconnect fabric for the trays. 
15 The cage may be configured with slots or rails to accept trays of different height form 
factors, such as 1.75 inch trays and 1 inch trays. 

Turning now to Figures 9A-9F, an example of such a cage or enclosure 950 is 
illustrated in various views. Figure 9A illustrates three trays 700a-c mounted in a single 

20 cage 950. Figure 9A also illustrates how each tray 700 may rest upon the ribs 702 of a 
lower tray or upon the floor of the cage. As shown in Figure 9B, the cage 950 may 
include multiple fans 960 at the rear of the cage. The fans 960 are configured to provide 
cooling for all of the trays 700 mounted in the cage 950. In one embodiment the fans 960 
are behind the cage back plane and the cage back plane is perforated or otherwise shaped 

25 to allow front to back airflow through the cage. Figure 9C shows a back view of the cage 
950 showing multiple fans 960, and Figure 9D shows a front view of the cage 950 
showing three trays mounted within the cage with the fans at the rear, as detailed in 
Figure 9A. Figure 9E is a side view of the cage and Figure 9F is a perspective view of the 
cage. 

30 
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Each of the trays as described in Figures 6A-9F may be a single field replaceable 
unit as described in regard to Figures 1-3. Figure 10 illustrates a method in which a user 
configures a plurality of field replaceable storage units in an enclosure, as indicated at 
1002. The enclosure may be a cage, rack, etc. Each field replaceable storage unit 

5 includes an array of hard drives and is configured to make the hard drives available on a 
network. A failure may be detected in one of the field replaceable storage units, as 
indicated at 1004. The failure may be a hard drive failure, power supply failure, 
processor failure, or any other failure that renders the unit wholly or partially inoperable. 
Instead of field servicing the failed unit to determine the failed component(s) and 

10 replacing the failed component(s) in the field, the user replaces filed replaceable unit as a 
whole, as indicated at 1006. 



Various modifications and changes may be made as would be obvious to a person 
skilled in the art having the benefit of this disclosure. It is intended that the following 
15 claims be interpreted to embrace all such modifications and changes and, accordingly, the 
specifications and drawings are to be regarded in an illustrative rather than a restrictive 
sense. 
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